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(57) Abstract 

A system separates unknown signals which have been combined together through unknown linear filters and for which ob- 
servations at multiple sensors are made, In a two channel circuit with two inputs and two sensors, the reconstructed source signals 
are assumed to be decorrelated such that the cross-correlation between the reconstructed source signals is near zero. The transfer 
functions which represent the crosstalk processes are estimated. The output signals are detected and the transfer functions are rec- 
ursively solved. A reconstruction filter is used to recover the original input signals. 
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MULTI -CHAN NEL SIGN AL SEPARATION 



B ackgro un d of t he Invention 

In a variety of contexts, observations are made 
of the outputs of an unknown mult iple - input 
multiple-output linear system, from which it is of 
interest to recover the input signals. For example, 
in problems of enhancing speech in the presence of 
background noise, or separating competing speakers, 
multiple microphone measurements will typically have 
components from both sources with the linear system 
representing the effect of the acoustic environment. 

Considering specifically the two-channel case, 
it is desired to estimate the two source signals s^^ 
and s 2 , from the observation of the two output 
signals y^ and y^. In many applications one of the 
signals, s 1 is the desired signal, while the other 
signal, s 2 , is the interference or noise signal. 
Both desired and noise signals are coupled through 
the unknown system to form the observed signals. 

The most widely used approach to noise 
cancellation, in the two channel case, was suggested 
by Widrow et al_^ in "Adaptive Noise Canceling: 
Principles and Applications'* , Pr o c^_I EEE , 
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63:1692-1716, which was published in 1975. In this 
approach, it is assumed that one of the observed 
signals, - the primary signal, contains both the 
desired signal and an uncorrelated interfering 
signal, while the other observed signal. y 2 - the 
reference signal, contains only the Interference. 
The system that couples the reference signal into 
the primary signal is found using the least mean 
square (LHS) algorithm. Then, the reference signal 
is filtered by the estimated system and subtracted 
from the primary signal to yield an estimate of the 
desired signal, s^. For example, U.S. Patent Ho. 
4,773,906 issued to Varnaka et al . used Widrow's 
approach and assumptions In an acoustic cancellation 
structure . 

The main drawback of Widrow's approach lies in 
the crucial assumption that the reference signal is 
uncorrelated with the primary signal. This 
assumption is not realized in practice due to 
leakage of the primary signal Into the reference 
signal. This degrades the performance of Widrow's 
method. Depending on the leakage (or cross -talk) 
power, this degradation may be severe, leading to a 
reverberant quality in the reconstructed signal 
since a portion of the desired signal is also 
subtracted, out of phase, together with the 
interference signal. Thus, a method of 
reconstruction is needed that can operate without 
making the unrealistic no-leakage assumption. 
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Summary of the Inven tion 

The invention proposes an approach to estimate 
a plurality of input source signals, which passed 
through an unkno wn mul t ip 1 e - input mult iple - output 
system, from observations of the output signals. It 
suggests, in fact, a solution of the problem of 
signal separation from their coupled observations. 
In the two channel case, the invention suggests an 
approach to estimate the desired signal (i.e., to 
cancel the interfering signal) or to estimate both 
source signals, in the more realistic scenario where 
both signals are coupled into the observed signals, 
and thereby overcoming the main drawback of the 
previous techniques. 

The invention comprises a signal processing 
system including a plurality of detectors for 
receiving plural observed signals, which, as 
mentioned above, results from plural source signals 
subjected to an unknown transfer function. A 
processor receives the observed signals and 
estimates the components of the transfer function, 
which are used to produce a filter (for example, but 
not necessarily, an inverse filter) for recon- 
structing the input source signals. The criterion 
for the estimate, or for the production of the 
reconstruction filter, is that the reconstructed 
source signals are uncorrelated . No assumption is 
made about the observed signals . Decorrelating 
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the reconstructed sisals implies that the source 
signals, which became correlated In the observation 
duc to coupling, are separated at reconstruction. 

In the two channel case, the original source 
signals are denoted s a and the separation system 

will only reconstruct s, and «»"-" e ^ ^ 
separated source signals processed by the filters. 

n ^o«*» when the reconstructing 
In this two channel case, wnen 

filter is an inverse filter, i.e.. its response is 
the inverse of the system response, the first 

. . , v is passed through a filter H 21 
observed signal, y,, is I 1 "" ° 7 

(which is an estimate of the system H ai that couples 

into y,). to yield a signal v,. The other 
observed signal y, is passed through a filter H 
Cwhich is an estate of the system H,, that couples 
s , into y,). to yield a signal ^. Then v x is 
subtracted from y 2> v, is subtracted from y, and 
each of the resulting difference signals is passed 
through another system 1/G. to yield^the 
reconstructed source signals ^ and « 2 - ■ The ^ 
components of the reconstruction filter. H 12> H 
and 1/G are estimated from the observed data so that 
the reconstructed signals are decorrelated. When it 
ls assumed that the coupling system H M is ««.. and 
its estimate is forced to be zero, the standard ■ 
Widrov's method results. By assuming decorrelated 
reconstructed outputs . no assumptions need be made 
regarding the observed signal. If one transfer 
component of the reconstruction filter is known. 
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then the other transfer component can be estimated. 
This criterion can be used with several other 
assumptions. For example, the generating system 
transfer components and can have finite 

impulse responses which have finite lengths. Then, 
the inverse filter for the generating system can be 
calculated to determine the reconstruction filter. 

In another embodiment, the reconstruction 
filter can have a finite impulse response. If 
either or H 12 are known, then the other can be 

calculated and reconstructed output signals 
developed. Also, only partial knowledge of the 
transfer components is needed to accurately 
calculate the reconstruction filter. 

In the preferred embodiment, it is assumed that 
the generating system transfer function is an FIR 
filter; thus, the coupling systems H 12 and H 21 have 
a finite impulse response <FIR) . In other words, 
the coupling filters can be represented as tapped 
delay lines, where each delay segment is multiplied 
by a filter coefficient and all the outcomes are 
summed to yield the filter output. The estimate of 
the coupling FIR system is performed via an 
Iterative process. The processor alternately solves 
for the coefficients of one system, assuming that 
the other system is known. 

A similar processor and embodiment is obtained 
when the reconstruction filter is forced to be an 
FIR system. 



Mimosa 07/03/1997 09:32:57 



WO 93/05503 



PCT/US92/07355 



-6- 



In another related embodiment, the processor 
that determines the unknown transfer functions and 
produces the reconstruction filter (e.g., the 
inverse fitter) is adaptive. The processor updates 
the components of the transfer function as more data 
is available, and based on the previous estimate of 
the input source signals. This embodiment 
represents a class of possible algorithms of various 
methods for sequential updating of the parameters. 

One application of the invention would be in a 
signal enhancing scenario in 'a room. The first 
(primary) microphone is close to the speaker and the 
other (reference) microphone is close to the noise 
source. However, the microphones need not be close 
to the sources. The first microphone detects the 
desired speech signal with some noise, and the 
second microphone detects mainly the noise with some 
speech leakage. The coupling is due to the unknown 
acoustic room environment. The processor of the 
invention is used to reconstruct the desired speech 
signal without the interfering noise. When the 
second signal source is another speaker, the 
processor of the invention separates both speech 
signals from the detected microphone signals that 
contain their coupled measurements. In the context 
of speech signals, the invention processor, for 
example, can be used as a front-end in automatic 
speech recognition systems operating in noisy 
environments, or when there is a cross -talk from an 
interfering speaker. 
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Al though the preferred embodiment operates for 
speech signal in an acoustic environment, the system 
for multi-channel signal separation can be applied 
to many different areas. For example, a 60 Hz 
interference from electrocardiogram can be deleted, 
even in cases when the reference contains some of 
the desired signal. Other applications may include 
cancellation of noise signals in telemetry system. 
Also, interfering signals in an antenna system can 
be cancelled using the proposed algorithm. 

The above and other features of the invention 
including various novel details of construction and 
combinations of parts will now be more particularly 
described with reference to the accompanying 
drawings and pointed out in the claims. It will be 
understood that the particular choice embodying the 
invention is shown by way of illustration only and 
not as a limitation of the invention. The 
principles and features of this invention may be 
employed in various and numerous embodiments without 
departing from the scope of the invention. 

Brie f Descri p tion o f the Dra wings 

Figure 1 is a schematic illustration of a 
general signal processing system embodying the 
present invention. 

Figure 2 illustrates a general two channel 
system where , H 12 , H 21 and R" 22 represent the 
transfer functions of four single-input single- 
output systems . 
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Figure 3 represents a schematic representation 
of IT 1 , the inverse of the estimated system of 
Figure 2. 

Figure 4 represents another schematic 
representation of a possible reconstruction system. 

Figure 5 illustrates an embodiment of the 
signal processing system that implements an 
iterative process for estimating the coupling 
systems. 

Figure 6 Illustrates an embodiment of the 
signal processing system that implements an adaptive 
sequential algorithm for estimating the coupling 
systems. 

Figure 7 illustrates a speech enhancing and 
noise cancellation system using the signal 
processing circuit of the invention. 

Figure 8 illustrates a signal enhancing system 
in an underwater acoustic environment. 

Figure 9 illustrates a tapped delay line. 

Detailed DP.ficriptioti Invention 

Figure 1 illustrates schematically the 
operation of the signal separator of the invention. 
Two signals, s L and s 2> are processed by an 
environment 10 which is represented by a transfer 
function H. Figure 2 shows the transfer function H 
in more detail. The transfer function H produces 
output signals and y^ The output signal J x 
comprises the signal s t and a filtered version of 
signal s . The output signal y 2 comprises the 
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signal s 2 and a filtered version of signal 

Thus, the environment 10 represented by transfer 

function H produces signal leakage or cross talk in 

both output signals y^ and y 2 . The processor 14 and 

the reconstruction filter 12 operate under the 

criterion that the reconstructed source signals, 

. y\ 1 
and s^, are uncorrelated. 

Processor 14 recursively operates on the 
values of detected output signals, y^ and y 2 , and 
reconstructed source signals, s x and s 2 , to produce 
an output 13 which updates the system components of 
reconstruction filter 12. Thus, crosstalk in the 
detected output signals, y ± and y % , is compensated 
and the reconstructed source signals, s 1 and s^, 
converge to the actual values of signals &1 and s 
respectively. A detailed explanation of this 
process is recited below. 

A general two-channel linear time invariant * 
(LTI) system can be represented in the form shown in 
Figure 2, where H^w), H 12 (v), H^ir), and H 22 (w) 
represent the transfer functions of four 
single-input s ingle - output LTI systems. Thus, 
Figure 2 illustrates the environment of H(w) that is 
used to develop the inverse transfer function H* 1 (w) 
which is required to reconstruct signal sources 
s 1 (n) and s 2 (n). The problem specifically considers 
estimating s^n], s 2 [nj. H 12 (c), and H n ( w ), in 
some scenarios, such as when one sensor is close to 
each of the signal sources s a (n} and s fe [n], it is 
appropriate to assume H^w) - H 22 (w) - 1. i n other 
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scenarios, vhan this is not the case. Chen the 
formulation is still directed at separation of s^n} 
and s,ln], but not full recovery of the input 
signaL. in many cases this .nay still be an 
acceptable objective. For example, if either sjn] 
and s bl nl or both are speech, for a wide class of 
transfer functions K^v) and H 22 <w> separation of 

rial - .,w f«V - ^ is 8u « 1 ; 1 " c d 

for intelligibility. Also, assume that H^v) and 
H (v) are stable LTI systems, and denote their unit 

21 i. r„1 and h Tn] respectively, 

sample responses by b^Ln] and b 21 inj 

Consequently, 

(1) 

n [ n ) = iuIn] + M"]*»jW 

y2 [n) = «aW + W«] 0< xW <2> 

wh ere * denotes convolution. We further assume that 

The signals s^n] and s.ln] are considered to 
b e sample functions from stochastic processes havxng 
stationary covariance functions. For notational 
simplicity, it is assumed that s^n] and s^n] are 
ze ro mean. Consequently the auto-covariances and 
cross-covariances are given by 



S _ - » (4a) 
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r»|Jt] * EU 2 \n]s' 2 [n-k)} 



(4b) 
(4c) 



The 



where E{.) denotes expected value, 
corresponding power spectra will be denoted as 
P slsl ({J >- P S 2 S 2 <U) ' and P sl s2 (w > respectively It 
should be stressed that the zero mean assumption is 
not necessary and the derivation and results apply 
dually to the more general case of nonzero and 
time-varying mean values, since they are phrased in 
terms of covariances. 

The desired approach comprises developing 
estimates of s^n], .^j, and che lln#-r 

H 12 <«> and H 21 < W ) subject to satisfying the model of 
Equations (1) and (2), the additional assumption of 
Equation(3). and appropriate constraints on 
P slsl (w) - P s2s2 (<tf >- and P sls2 (w) - 

From Equations (1) and (2) or Figure 2, the 
transfer function matrix H(w) is 



H(u;) = 



1 H lt (w) 
H n (u>) 1 



(5) 



and correspondingly the transfer function of the 
inverse system is 
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which is stable under the condition of Equation O) . 

FroBl (6) and the well-known relationship for 
power spectra at the input and output of LTI 
systems, we can write that 

* \ p foO are known, 

If *sl S l (u)> P s2s2 (w)( and r , 

„«i»«.. ie i l2 (.).H il w. 'i ,B, '" 4 ? ,,, e • 

consistent with Equations (7) and the model of. 
Equation (1) are determined. However, the source 
power spectra are generally not known, so Equation 
(7) has too many variables to be solved. 

I ..H..tlor» ' Pecorrelation 

It has been determined that Equation 7(a) can 
be readily solved by assuming that P sls2 («) - 0. By 

« that P („) - 0. i-e. that sl and s2 are 
assuming that *.i. 2 < w} ' fae deterffiined 

not correlated, either H 12 or can 
in terms of the power spectra for detected signals 
7 X and y2 and the estimate for the other transfer 
Lnction component exists. Thus, an adequate number 
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of unknowns are eliminated from Equation 7(a) to 
permit its solution. 

Estimates of s^n], s^n] and the linear 
systems H^C) and H 21 ( w ) to satisfy the model of 
Equations (1) and (2) and the constraint that 
P sls2^ w ^ " ® are dete ^mined recursively. 
Specifically, H 12 ( w ) and H 21 ( w ), estimates of H 12 < w ) 
and H 12 (o>) ( are chosen to satisfy (7a) with P ( w ) 
- 0 ( i.e. Sls2 

WW ~ - + SnWH^P^u) = 0 (8) 

Where P yly2 (w) ' P y2y2 (u>) ' and p ylyl< w > a " estimated 
from the observed data. 

The estimates s^n] and s 2 [n] are then obtained 
by applying to the data the inverse filter H* 1 ( w ) 
given by 

Referring to the embodiment of Figure 1, 
processor 14 estimates a first system cross 
component, generates the second system cross 
component to satisfy Equation (8), and then &l and 
s 2 are generated by the reconstruction filter, using 
an inverse filter. 
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Clearly, Equation (8) does not specify a unique 
solution for both H^OO and H 21 <-> and any solution 
will result in estimates of s^n] and which 
satisfy the decorrelation condition. Several 
specific approaches which further constrain the 
problem to eliminate this ambiguity are discussed „ 

Section II- 

If one of the transfer function components 

H„<->. H 21 W I- the ° ther ^ ^ S ° 1Ved 

easily using Equation C8>- For example, one 
straightforward constraint which leads to a unique 
solution of (8) and unique estimates of s^n] and 
s t n] results from having R 21 ("> specified. In th,s 



case , 



ft.-M-g&(u>)fi, w M 

If the data satisfies the model of Figure 1 and 
i£ the estimates of P yly2 C»> •** *jl 7 2 "* 
then the estimate of H^C) will also be exact. 

Correspondingly, if H 12 €») 1- *">™- then 



u n f Fieure 1 can utilize 
Ihus, processor U or "g utc 

s-irw f[*[} where one transfer 
either Equation (10) or ILL), 



Mimosa 07/03/1997 09:32:57 



WO 93/05503 



PCT/US92/07355 



-15- 



f unction component is known, to find the other 
component, and apply the inverse filter to generate 
the source signals. 

When H^i^u) equals zero, the solution reduces 
to the result used in the least mean square (LMS) 
calculation. As an interesting special case, 
suppose H^Cw) is assumed to be zero, i.e. in Figure 
2 there is assumed to be no coupling from s^tn) to 
the first output y^fn]. In this case, from (10), 

= ^H&T (12> 



and 



5-i["l = yiH-A„[n]*y 2 fn] < 13 > 

This choice of H 12 (w) is in fact identical to 
that used in Widrov's least squares approach. 
Specifically, it is straightforward to show that if 
s^[n] is estimated according to (13), the choice of 

2 

H 10 (w) as specified in (12) results in E{s [n] } 
iZ 1 

being minimized. The least squares approach of 

Vldrow has been extremely successful in a wide 

variety of contexts. It is also generally 

understood that some of its limitations derive from 

the key assumption that H^ 2 (w) - 0. Equation (11) 

suggests a potentially interesting modification of 
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the least squares method to incorporate non-zero but 
specified coupling - 

Figure 3 illustrates the inverse of the 
estimated system of Figure 2. Reconstruction filter 
12 uses an inverse filter to reconstruct source 
signals Sl and « 2 . Detected first observed signal, 
y , is passed through system H 12 to yield Uj. The 
other observed signal j 2 is passed through a filter 
H. . to yield a signal V Then, U 2 is subtracted 
from y 2 , U 2 is subtracted from y^ and each of the 
resulting difference signals which are Vj^ and V 2 , 
respectively, are passed through another system. 1/G 
to yield the reconstructed source signals s^ and 
If the original system is not comprised of finite 
impulse response filters FIRs. both system 
components cannot be determined. One component must 
be assumed and the other solved. 

Figure 4 illustrates a reconstruction filter " 
where the cross transform components. 38 and 40, are 
FIRs. As will be discussed in detail below, this 
permits the concurrent calculation of both cross 
components . 

If both H 12 (o>) and H 21 <») are unknown, we then 
need to jointly estimate them. As already 
indicated, imposing the assumption that the signals 
are uncorrelated is insufficient to uniquely solve 
the problem. In order to obtain a unique solution, 
we must incorporate additional assumptions 
concerning the underlying model. 
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One possibility is to assume statistical 
independence between s^n] and s 2 [n] . If the 
signals are not jointly Guassian, this is a stronger 
condition than the assumption that the signals are 
statistically uncorrelated. By imposing statistical 
independence between the estimated signals, 
additional constraints on the high order moments of 
s^n] and s 2 ^ n ^ are ODtained » that can be used to 
specify a unique solution for both filters. 

1 * • E sti mation Based on D e correlation and a n F IR 
Co nst raint 

Another class of constraints leading to a 
unique solution for H^Cw) and H 21 <w) is comprised 
of restricting the two linear filters to be causal 
and finite impulse response (FIR) with a 
pre -specif led order. 

As explained below, both h^ 2 and h^ can be 

represented as tapped delay lines with filter 

coefficients a and b , respectively. Figure 9 
n n 

illustrates a tapped delay line which can be used as 
an FIR filter. The line consists of a plurality of 
delays 90 t 92, 94, 96, and 98. The output of each 
delay is multipled by a respective coefficient al to 
a5 . This multiplication occurs in multipliers 102 , 
104, 106, 108, and 110. The outputs of the 
multipliers are added by summer 100 to produce an 
output signal y . 
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Consider h 12 [»] and h 2l [nl to be FIR filters 
and, thus, of the form 



h l2 [n] = ! ^ 0<»£ft-l (14) 

^ 0 otherwise 

, r . / *„ 0<»<ft-l 

*zil n J _ 1 0 otherwise 



(15) 



The filter coefficients (aj and (bj are 
unknown and the filter lengths ,j_ and q 2 are assumed 
known. Since we now have (, 1+ q 2 > unknowns. Equation 
(8) or its equivalent in the time domain should, in 
principle, provide a sufficient number of 
(nonlinear) equations in the unknown filter 
coefficients to obtain a unique solution. In the 
following discussion, a specific time domain 
approach to obtaining the filter coefficients is 
developed. As noted above, the inverse system 
H - l Cw) as given by Equation (6) is represented by 
the block diagram in Figure 3. where G(w) - 1 - 
H (w)H 21 (w). The Figure 3 parameters. v x (n) , 
v 2 <n), and g n . are defined as follows: 



= yi(n)-W n )°w( n ) (16) 
= yi(n)-2n 8 »2( n ) 
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M n ) = y3( n )-^2i( n ) * fi( n ) (17) 



and 



g n _ Ai 2 (n)»A 21 (n) (18) 

= £ n - Sn * b n 

where 6 is the Kroneker delta function. With these 
n 

definitions, the equations for the signal estimates 
are given by: 

? n *? x (n) = v^n) (19) 
?n*? 2 (n) = d 2 {n) < 20 > 

From Figure 3 (or Equations (16) and (17)), 
Equation (8) can he rewritten in either of the 
following two forms: 



(21) 



(22) 
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where P yivj <»> i, J - 1,2 is the cross spectrum 
between y t (n) and v. (n) . 

Equivalents In the time (lag) domain we 

obtain: 

(23) 

&u*«W«) = ^..(n) (24) 

where c yIvj (k) is the covariance function between 
y t (n) andVj(n), i.e., 

v .[n) = E{y i {k)v+{k-n)}-E{ Vi (k)}E + {v j {k-T,)} ij = l,2 (25) 

and + denotes. complex conjugation. 

Under the assumption that s^t) i - 1,2 are 
zero mean then y^t) and v^t) i,J - 1/2 are also- 
zero mean, in which case the second term on the 
right side of Equation (30) to be discussed below, 
equals zero, and c y - vj <n) is a correlation function. 
Otherwise, the covariance must be computed. 

Expressing (23) for n - 0,1,2 (q^D 1» * 

vector form 

c w 4S)a = c^(5) c*6> 

where 
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O = 



<*0 

«1 



(27) 



b = 



(28) 



J 



Similarly, expressing (24) for n 
1/2/. . . , (q 2 -l) in vector form 

c Vl01 (s)£ = Cv50) (a) 



(29) 



Thus, for a pre - specif ied b, the solution to a 
is given by 



(30) 



and for a pre -specif led a, the solution to b is 
given by 



If b - 0 is substituted in (30). we obtain the 
least squares estimate of a (under the assumption 
that in fact b - 0). Equation (30) therefore 
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suggests a modification to the least squares 
solution in the FIR case, that incorporates 
situations in which b is non-zero. 

To estimate a or b from the observed data, we 
replace the covariances in Equations (30) and (31) 
with their sample estimates.. Specifically, the 
expectations are approximated by the empirical 
averages: 

c m ® - yn 1 0n - k £fi n - k °myiw (32 , 



6-1 

where « and * are real numbers between 0 and 1. To 
achieve maximal statistical stability, we choose « - 
B - 1 If however, the signals and/or the unknown 
parameters exhibit non-stationary behavior in time, 
it is preferable to choose «. P < 1. I» this way 
exponential weighting can be introduced so that the 
signal and parameter estimates depend more heavily 
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on the current data samples, and in effect an 
adaptive algorithm is created that is capable of 
tracking the time-varying characteristics of the 
underlying system. 

The form of the empirical averages in (32) and 
(33) suggests solving (30) recursively. Using 



■ l& 



1-1 



Qiv) = E0 n - fc *+(*)yj(fc) 



= [M- , (n-l) + .+(n)yJ(n)] 



-1 



= ^|Q(n-l)- 



Q(n-l)vtWyl(n)Q(n - 1) 



P + vl(n)Q(n-l)vt(n) 



(36) 



and 



«(») = E^"*^ (*)»!(*) 



(37) 



a(n), the estimate of a based' on data to time n, can 
be defined as 



o(n) = <?(n)«(n) 

= Q(n)[/3q(n-l) + vl(n) yi {n)] 

= <3(n)[^<?-V-l)a(n-l)+ W +(n)»,(n)] 

= <?(")tf • j[Q~\n) - ^(n)vJ(n)]S(n - 1) + •f(n)y I (»)> 

= 8(n-l)+Q(n)[t»+(n)y a (n)-ti+(n)y7(n)a(n-l)] 

= a(n-l)+Q(n) 0 +(n)[ yi (n)-vJ(n)a(n-l)] 

= a(n-l) + Q(n)t.+ (n) 0l (n|n-l) 
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where 



n(n|n.I)= yi (n)-y7(n)«fn-l) {39) 

Similarly, the solution to (31) caa be computed 
recursively as follows: 

g {n) = S(„_l) + Jl(n)«+(nMn|n-l) («) 

I [ R(n-l)vt(n)yJ{n)R(n-l) ] (41) 

*(n) = -^(«-D- Q + y T (n)H(n _ lK(n) J 

where 

* (n) = [|> n ^ ( * )y7(fc) ] 



(42a) 



and 



dHn - 1) = y,(n) - yftn^n - 1) < 42b ) 

If b - 0, then (38) becomes-, the : well-known 
recursive least squares (RLS) solution of the least 
squares problem. Thus, (38) caa be viewed as a 
generalization of the RLS solution to a when b is 
specified and not restricted to be zero. Similarly, 
(40) is a generalized RLS algorithm for obtaining b 
when a is specified and not restricted to be zero. 
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Time domain solutions can also be adequately handled 
by tapped delay line methods. 

At times, both a and b are unknown vector 
parameters to be estimated. The form of (30) and 
(31) suggests the following iterative algorithm: 



(43) 



5(0 = ^.(a'^K,^'-')) (44 > 

where a (i) and b (i) are, respectively, the estimates 

of a and b after i iteration cycles. To implement 

the- algorithm, we use the empirical averages given 

in Equations (32) -(35). Of course, for a given 
K (i-1) (i) , 

d , a may be computed recursively in time 

using (38). Similarly, for a given a**" 1 ), b (i) may 
be computed using (40). 

This iterative process is shown in the 
embodiment of Figure 5. To obtain a fully recursive 
algorithm, we suggest incorporating (38) with (39), 
where in the recursion for estimating a f b(n) is 
substituted for b (i) , and in the recursion for 
estimating b, a(n) is substituted for a (i) . Note 
that replacing the iteration index by the time index 
is a common procedure in stochastic approximation. 
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T hus. asanalternacive Co (43) and (44). the 
foU owin B iterative procedure is used to solve (26) 

and (29): 

a<0 = a«-) +7 !')[c„, (5"-') a"-] <«> 



E 1 " 



(*> ani , CX) are constant gains (step 
where ^ and t lteratl „ n index. This 

sizes) that may depend on the It 

alg orith m can be viewed as an iterative gradient 
search algorithm for solving (26) and (29). 
TJsing, 

W*)- c -( s ) a = Mi*™*)} ( * 7) 



(48) 



first order stochastic 
Then, using the first oru _ OT , r 
fllfld replace expectation by current 
approximation method, repiac r 

- w iteration index by the time index 
realization, and iteration 

t. obtain the following sequential algorithm: 
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n) = «("-l)+7i(n).c+(a|n.l )lll(n , nfcl) 

1) + 7:(n) • *+(n|n - l)v 2 {n\n - 1) < 50 > 
is the vector defined in (39) 

computed using a - a(n-l) , and v^Cn/n-l) is the 

vector defined using b - b(n-l). 

The flow chart in Figure 5 illustrates the 
adaptive sequential algorithm which estimates a (i) 
and b (i) recursively using Equations (49) and (50), 
then generating v x (i) and v 2 (i) according to 
Equations (16) and (12) and finally generating s 1 
and s 2 according to Equations (19) and (20), 
respectively. Block 110 illustrates the setting of 
the initial estimate of a. As shown in block 112, 
v^ is calculated using the initial a values and the 
detected signals, y 1 and y 2 , in accordance with 
Equation (16), The value v^ is used to perform the 
calculations shown in block 114 in Figure 5(a). 
According to Equations (34) and (35), values are 
calculated for c ylvl and c y2vl . Next the values for 
b are calculated using Equations (31) and (41) as 
shown in block 116. The values for b are then used 
to find v 2 in accordance with Equation (17) as shown 
by block 118. Using this value, Equations (32) and 
(33) are used to calculate C y2v2 and c ylv2 as shown 
in block. 120. Next, values are found for A^ k+1 ^ . 



6(n) = 6( n - 
+ 

where v (n/n-1) 
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Block 124 determine whether convergence has 
Block 124 lcera tIons need to be calculated, 

occurred. If »ore iteration rest art*d 
k is set eo.ua! to k + l and calculations are restar 
in block 112- « conversion has occurred the 

... £et .<k*« are set equal to the estimate for 
values for a calcu iated values for 

h Also in block 128, trie 

e,ual to the estimate for the transform 
V xL final calculations are made as shown in 
"fock 130 and 132. As shown in bloc* : 130 g n x. 
calculated using Equation (18) and. finally. 

mates are made for the reconstructed outpu 
signals s.and s, using Equations (19) and (20). 

respectively. 

Figure 6 illustrates an embodiment of the 
signal processing «=h.t implements the 

S 6 F _ . a i ff orithm of the flow chart of 

adaptive sequential algorrttim ^ laved 
F igure 5. Detected signals v, and y, are delayed. 
Oelay line 44 with a length q, delays detected 
signal y and delay line 46 with the length ^ 
X i -tected signal y ,. Xn block 42. values 

' (n/n-1) are calculated in accordance w.th 
Uclon(3 9 ). Blocks (46) and (48) ar, used o 

M with Eau.ati.oii 

calculate Q(») In accordance wrth q 

Values for the estimated filter cffxe n a ar 
calculated in accordance with Equation 38) b u.1 

- ho . es 42 and 46 . The values for 
Che outputs of boxes ^ 

a<«> as calculated by the processor of Figure 6 
I : us o to update the reconstruction filter 
Figure 1. A. similar process is used to calculate 
Z values of filter coefficients b. Thus, updated 
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reconstructed output signals can be derived. It 
should be noted that this embodiment represents a 
class of algorithms where the adaptive techniques 
can be varied to make a smooth estimate of several 
components of v^ and v^ . 

By assuming the reconstructed outputs are 
decorrelated, no assumptions need be made regarding 
the observed signal. If one transfer component, for 
example H 12 , is known, then the other transfer 
component H 21 can be estimated. The criterion of 
decorrelated reconstructed signal outputs can be 
used with several other assumptions. For example, 
the generating system transfer components H 12 and 



H 



21 



can have finite impulse responses. Then the 



inverse filter for the generating system can be 
calculated. In another example, the reconstruction 
filter can have a finite impulse response. If 
either H n or H 12 are known, then the other can be 
calculated and reconstructed output signals 
developed. Also, only partial knowledge of the 
transfer components is needed to accurately 
calculate the reconstruction filter. Thus, if 
either the phase or magnitude of the filter 
components is known, the other parameter can be 
calculated and the reconstruction filter completely 
described. These examples are not limiting, but 
merely representative of some of the contexts in 
which the signal processing device of the invention 
can be used. 



Mimosa 07/03/1997 09:32:57 



WO 93/05503 



PCT/US92/07355 



-30 



f 4 i ter with some parameters 
The recoastruction filter wit-u 

unknown can also be updated or .edified with time 
variant data by forcing the output to be 
^correlated. Thus, the algorithm can be adaptive 
ln tU. and sequential, i.e. updated as .ore data 
obtained. The algorithms can also be used in 
concurrent processing. 

Figure 7 illustrates the preferred use of the 
invention in a speech enhancing and noise 
cancellation system. The separation of voxce 
signals from interfering noise signals in a room can 
he easily accomplished using the signal processing 
device of the invention. For example. Figure 7 
illustrates an individual 61 in room 57. Also „ 
C he room is a communications device 60 such as TV 
er a radio. Kicrophone 54 is located near the no 
source 60. Microphone 56 is near the desired signal 
source from the individual 61- Due to the room 
acoustics, both signals are picked up by both 
aerophones. The processing and reconstruction 
device 58 opiates on the detected signals m 
accordance vith the principles described above. 
Thus, the desired signal from source 61 can be 
derived without interfering reverberation be.ng 
caused by the processing. The desired signal 
^constructed from device 58 can then be processed 
by a speech recognition device 63. 

The signal separator of the invention can also 
be used in a moving vehicle, such as a car. A 
aerophone can be located near the muffler and 
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another microphone near the speaker. The speaker's 
microphone could be a car phone. The noise caused 
by the muffler can be eliminated by using the signal 
separator of the invention. Moreover, since some of 
the generating transfer functions are known or can 
be calculated from the car acoustical environment, 
calculations can be simplified in the reconstruction 
filter. 

Figure 8 illustrates a signal enhancing system 
in accordance with the invention in an underwater 
acoustic environment. A sonar array 64 is used to 
determine the position of target 66. Noise 
generated by propeller 70 interferes with this 
determination. Accordingly, microphone 62 generates 
an output signal which is processed with the signals 
from array 64 by signal separation device 68. Thus, 
despite the leakage of sonar signals from array 64 
to microphone 62. an accurate target signal can be 
calculated . 

Although speech processing is the preferred 
application of the invention, the signal processing 
device can be applied in many fields. For example, 
noise cancellation in a telemetry system can be 
effected by means of the signal enhancement device. 
Electrical signals from the human body, such as 
those processed in an electrocardiogram, can be more 
accurately determined by means of the invention. 
Also, antenna signals can be more accurately 
determined by means of the invention. 
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Equivalents 

Those skilled In the art will recognize, or be 
able to ascertain, using no more than routine 
experimentation, many equivalents to the specific 
embodiments of the invention described herein. 

These and all other equivalents are intended to 
be encompassed by the following claims. 
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CLAIMS 



• A signal processing system comprising: 

a plurality of detectors for detecting 
source signals subjected to a generating system 
transfer function; 

a processor for receiving the detected 
signals and producing a reconstruction filter 
for filtering the detected signal to produce 
reconstructed source signals, the 
reconstruction filter" being produced such that 
correlation between reconstructed source 
signals is forced to approach zero even when 
each detector receives sources signals from 
plural sources; and 

said reconstruction filter for receiving 
the detected signals to generate a 
reconstruction of the various source signals' 
without interference from any of the other 

source signals. 

A signal processing system, as recited in Claim 

1. wherein the reconstruction filter is 
Inversely related to said transfer function. 

A signal processing system, as recited in Claim 

2, wherein soma of the transfer function 
parameters are known. 

A signal processing system, as recited in Claim 
2. wherein none of the transfer function 
parameters are known and the transfer function 
has a finite impulse response. 
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6. 



* signal processing system, as recited in Clai* 
wherein the reconstruction filter is 



4 

Iterative. 



o 



o 



A signal processing system, as recited in Claim 
4, wherein the reconstruction filter is 
adaptive. 

A signal processing system, as recited in Claim 
1, wherein the reconstruction filter has a 
finite impulse response. 

A signal processing system comprising: 

a first detector for receiving at least 
ne source signal subjected to a generating 
system transfer function; 

a second detector for receiving at least 
ne source signal subjected to said generates 
system transfer function; 

a reconstruction filter including a first 
transfer function to which a first signal from 
the first detector is applied and a second 
transfer function to which a second input 
signal from the second detector is applied, the 
output of the first transfer function being 
subtracted from the second input signal and the 
output of the second transfer function being 
subtracted from the first input signal; 

such that the reconstruction filter for 
filtering the first and second signals produce 
reconstructed first and. second source signals 
with a correlation that is forced to approach 
2 ero even when each detector receives source 
signals from plural sources. 
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9. A signal processing system, as recited in Claim 

8, wherein the first and second transfer 
functions are tapped delay lines with a 
plurality of equal delay segments, the output 
of each delay segment is multiplied by a filter 
coefficient, and the filter coefficient outputs 
for the respective delay segments are summed to 
serve as outputs for the first and second 
transfer functions. 

10. A signal processing system, as recited in Claim 

9, wherein the reconstruction filter is 
inversely related to said transfer function. 

11. A signal processing system, as recited in Claim 

10, wherein some filter coefficients are known. 

12. A signal processing system, as recited in Claim 
10, wherein none of the filter coefficients are 
known and the generating system transfer 
function has a finite impulse response. 

13. A signal processing system, wherein the 
reconstruction filter is iterative. 

14. A signal processing system, as recited in Claim 
12, wherein the reconstruction filter is 
adaptive . 

15. A signal processing system, as recited in Claim 
1, wherein the reconstruction filter has a 
finite impulse response. 
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16. 



A method of multichannel source signal 
separation, wherein said source signals are 
subjected to a transfer function, comprising 

the steps of: . 

detecting a plurality of observed signals 
from at least one source signal subjected to 
the transfer function; and 

processing the detected signals and 
producing a reconstruction filter for filtering 
t he detected signal to produce reconstructed 
source signals such that the correlation 
between the various reconstructed source 
signals is forced to approach zero even when 
each observed signal receives source signals 
from plural sources. 

A method, as recited in Claim 16. wherein the 
reconstruction filter is inversely related to 
said transfer function. 

18 A. method, as recited in Claim 17. wherein some 
of the transfer function parameters are known. 

A method, as recited in Claim 17. wherein none 
of the transfer function parameters are known 
and the transfer function has a finite impulse 
response . 



17. 



19. 



20. 
21. 



A method, as recited in Claim 19. wherein the 
reconstruction filter is iterative. 
A method, as recited in Claim 19. wherein the 
reconstruction filter is adaptive. 
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22. A method, as recited In Claim 16, wherein the 
reconstruction filter has a finite impulse 
response . 

23. A signal processing system, for reconstructing 
first source signal and a second source 
signal which are subjected to a generating 
transfer function, comprising 

(a) a first detector which produces a first 
observed signal y^ from at least one source 
signal subjected to said transfer function; 

(b) a second detector which produces a second 
observed signal y^ from at least one source 
signal subjected to said transfer function; 

(c) a reconstruction filter including: 

(i) a first filter H^^ which processes 
the first observed signal y^ and produces 
a first output signal , 

(ii) a second filter which processes 

the second observed signal y^ and produces 
a second output signal , 

(iii) a first subtractor which subtracts 

from to produce V^ t 
(iv) a second subtractor which subtracts 

from Y 2 to produce V^ t 
<v) a processing transform which 
converts the signals and V^, respec- 
tively, into reconstructed source signals, 

and respectively, wherein the 

correlation between the reconstructed 
source signals is forced to approached 
zero, even when each detector receives 
source signals from plural sources. 
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A system, as recited in Claim 23, wherein the 
reconstruction filter is inversely related to 
said transfer function. 

A system, as recited in Claim 24, wherein some 
of the transfer function parameters are known. 

A system, as recited in Claim 24, wherein none 
of the transfer function parameters are known 
and the transfer function has a finite impulse 
response. 

A system, as recited in Claim 26 t wherein the 
reconstruction filter Is iterative. 

28. A system, as recited in Claim 26, wherein the 
reconstruction filter is adaptive. 



29. A system, as recited in Claim 23, wherein the 
reconstruction filter has a finite impulse 
response. 

30. A system for enhancing speech in a noise 
environment, where both the speech and noise 
are subjected to a generating system transfer 
function, comprising: 

a first microphone near a speaker which 
produces a first observed signal -y^ including 
at least one of speech and noise components, 

a second microphone near a noise source 
which produces a second observed signal 
Y 2 , including at least one of speech and noise 
components, 



24. 



25. 



26. 
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a processor for receiving the first and 
second observed signals, y 1 and y 2 , and 
producing a reconstruction filter for filtering 
the detected signals to produce reconstructed 
source signals, 

said reconstruction filter producing 
separate reconstructed speech and noise signals 
such that the correlation between the 
reconstructed signals is forced to approach 
zero even when each microphone detects both 
speech and noise components.. 

31. A system, as recited in Claim 30, further 
comprising a speech recognition device coupled 
to said reconstruction filter. 

32. A system, as recited in Claim 30, wherein the 
reconstruction filter is inversely related to 
the transfer function. 



33. 



34, 



35 



36 



A system, as recited in Claim 32, wherein some 
of the transfer function parameters are known. 

A system, as recited in Claim 32, wherein none 
of the transfer function parameters are known 
and the transfer function has a finite impulse 
response. 

A system, as recited in Claim 34, wherein the 
reconstruction filter is iterative. 
A system as recited in. Claim 32, wherein the 
reconstruction filter is adaptive. 
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37. A system, as recited in Claim 30. wherein the 
reconstruction filter has a finite impulse 
response. 

38. A signal enhancing system in an underwater 
acoustic environment, where both a desired 
signal and noise are subjected to a generating 
system transfer function, comprising 

a sonar array for producing and receiving 
ultrasonic signals, wherein the received 
signals represent a plurality of first observed 
signals Y^-Yp , including at least one of 
desired signal and noise components. 

a microphone near a noise source which 
produces a second observed signal Y 2> Including 
at least one of desired signal and noise 

components , 

a processor for receiving the first and 
second observed signals and Yj . and 

producing a reconstruction filter for filtering 
the detected signals to produce reconstructed 

source signals, 

said reconstruction filter producing 
separate reconstructed signals where the 
correlation between the reconstructed signals 
is forced to approach zero, even when the sonar 
array and the microphone both detect desired signal 
and noise components. 

39. A system, as recited in Claim 32. wherein the 
reconstruction filter Is inversely related to 
the transfer function. 
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40. 



41, 



42, 



43 . 



44. 



A system, as recited in Claim 39, wherein some 
of the transfer function parameters are known. 

A system, as recited in Claim 39. wherein none 
of the transfer function parameters are known 
and the transfer function has a finite impulse 
response . 

A system, as recited In Claim 41, wherein the 
reconstruction filter is iterative. 

A system, as' recited in Claim 41. wherein the 
reconstruction filter is adaptive. 

A system, as recited in Claim 38, wherein the 
reconstruction filter has a finite impulse 

response . 



Mimosa 07/03/1997 09:32:57 



WO 93/05503 



1/9 



PCT/US92/07355 




Mimosa 07/03/1997 09:32:57 



WO 93/05503 



Sb Cn] 




PCT/US92/07355 



y, [n] 



y 2 Ln] 



FIG. 2 , " , ""'" -r 

2. ^'7 K «^ J^w^s;-^ 5yW^ 




Y2 / 











FIG. 4 



Mimosa 07/03/1997 09:32:57 



WO 93/05503 



PCT/US92/07355 



3/9 



Set Initial Estimate 




(0) 

00 




o 101 = 


(0) 




K = o 





& 



no 



(K> 



Find Vi lK) Lnl 




(eqn 16) 


112 

y 


yi [n] - 


q,-l 
i=0 


- K3 






<> 






Generate 
and 


Cy, v, l0 W ) 
C y 2 v, (0^) 


(eqn 34) 
(eqn 35) 


114 








r 


Solve: 


.IK) _ r 

b - C y, v, 


(Eqn 31+41). 
(a )• Cy 2 V| lo ) 





FIG. 5 SHEET 



Mimosa 07/03/1997 09:32:57 



WO 93/05503 



4 / 9 



PCT/US92/07355 





Find v 2 (K) (n) = 


Eqn 17 


y 2 (n) - T bJ K, y ( .(n-K) 
i = 0 






Generate 




Cy 2 V2-{b (K1 ) 


Eqn 32 


and C y, v 2 (b <K) ) 


Eqn 33 



IS 



118 



120 



Z 



122 



Solve 

i (K+l) = C y 2 v 2 (b< K) f'. Cy,v 2 (bM) 



124 




FIG. 5 Sheet 2 



Mimosa 07/03/1997 09:32:57 



WO 93/05503 



PCTAJS92/07355 



5/9 




A 

Set h, 2 (i) = 






h2l (i) = 


bi lK) 


128 




A A 

[Implement inverse filter using h 12 . n 21 





(Eqn 18) 










A A 






= S n - h|2 * h2i 







1 



Solve for 


A 

S| 


(n) 


Eqn 


19 




A 

s 2 


(n) 


Eqn 


19 



132 



A 

S2(n) 



\7 

A 

Si (n) 



FIG. 5 Sheet 3 



Mimosa 07/03/1997 09:32:57 



WO 93/05503 



PCI7US92/07355 




Mimosa 07/03/1997 09:32:57 



WO 93/05503 



PCT/US92/07355 



7/9 




Mimosa 07/03/1997 09:32:57 




Mimosa 07/03/1997 09:32:57 



WO 93/05503 



PCT/US92/07355 



9/9 




Mimosa 07/03/1997 09:32:57 



ANHANG 

zua international en Recherchen- 
bericht uber die Internationale 
Patentanaeldung Nr. 



ANNEX 

to the International Search 
Report to the International 
Application No. 



Patent 



ANNEXE 

m rapport de recherche inter- 
national relatif a la deaande de brevet 
international n' 



PCT/US 92/07335 SAE 64753 

In diesea Anhang sind die hltglieder This Annex lists the patent faaily 
der PatentfaaiUen der io obenqe- members relating to the patent documents 

nannten international en Recherchenbericht cited in the above-mentioned inter- 
annefiBirten Patentdokuoents angegeben. national search report The Office is 
Oiese Angaben dienen nur xur Unter- in no Hay liable for these particulars 
rfSiMrt erfolgen chne 6(*ahr. Hhich are given merely for the purpose 

of infomaticn. 



La presente annexe indlque les 
neftbres de la fasille de brevets 
relatifs aux docuaents de brevets cit&s 
dans le rapport de recherche inter- 
national visSe ci-dessus. Lesreseignfr- 
Bents fournis sont donnte 4 titre indicar 
tif et n'engagent pas la responsibility 
de roffice. 



Ii Recherchenbericht 
angef uhrtes Patentdofcuaent 

Patent dccussnt cited 

in search report 
Document de brevet cite 
dans le rapport de recherche 



Oatuo der 
Vernffentlichung 
Publication 
date 
Date de 
publication 



«itglied(er) der 
Patentfanilie 
Patent f aolly . 
ate«iber<s> v 
ttenbrets) de la N 
fasille de brevets 



Datua der 
Verfiffentlichung 
Publication 

date 
Date da 
publication 



WO Al 8S01O54 



1 1-02-88 



US A 
US A 



4702110 
460251 1 



27-10-87 
29-07-86 



EP A2 



210607 



04-02-S7 



BR A 
EP TD 
EP A3 
ES AF 



3603507 
210609 
210609 
2001168 



JP A2 62029232 
US A .4677466 



04-03-87 
21-05-87 
15-03-89 
01-05-88 
07-02-87 
30-06-87 



US A 



4497601 



ke*irre — none — ri.en 



Mimosa 07/03/1997 09:32:57 



INTERNATIONAL SEARCH REPORT 

btt*mctto«wl ApoOctUon Ho 




2/07355 



IPC 



.5. G 10 L 9/08 



U. FIELDS SEA nCMEO 



OuiUicsfion Sfttcm j 



UiAlnutffl OocunxrtUtton S«tfcftcd ' 

q — .tattoo SyntboU 



IPC 



is 10 h 9/00, G 10 L 1/00. H 04 H 9/00, H 04 N 7/00, 
IH 04 R 3/00, H 03 J 7/00, H 04 H 1/00 



~ „*.«i«n SMfetMd ath^ttMA Mlolmara OocBinoaUttan 



m n^^L » with todkuuon. »<~« mc^KUt^ttK 



WO, Al, 88/01 054 
(MCS PARTNERS} 

29 December 1988 (29.12.88), 
see fig. 1; abstract. 

EP, A2, 0 210 609 

" (A.C. NIELSEN COMP) 
04 February 1987 (04.02.87), 
see fig. 1; abstract. 

US, A, 4 499 601 

(MATTHEWS ) 12 February 1985 
(12.02.85) , 

see fig. Ii2; abstract. 



1-44 



1-44 



1-44 



• Social cxtoom* ol eft* doc*m««u: « 
-A" docum.m dicing m. •«••«»• « rt whlCh to ° 0t 

document cut Btt WIih«d ea or ttor i«t.m-U««l 

SSuw or oth.r «(HKi.l ««<* (« .P«*««H 
-O- docum.nt r^rina to an orl dl«do«if ««. •«W bW « or 
ethar m«t«f . . 

- docwMAt oublichtd oriof M th- Urt.m«tio«ul «<kj «4t. but 
Utor Ilea th« pfiofrtf d«W eUim«d 

(V. CERTIFICATION 



21 December 1992 



lnt«m«ilOA«J S*«feWno Awtftocttj 

EUROPEAN PATENT OFFICE 



-4- docurrwH* «Hml»f of th« mn< prttfU Urn** 



Oct* at MtiOaa ol thU IfltofwUat*! S*««ft Rtport 

* 5 JAM-ifiML 



SlOtMtur* o< A«ithort*«d Offle«f 

BERGER e.h. 



Mimosa 07/03/1997 09:32:57 



